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Abstract. We investigate the local times of a continuous-time Markov chain on an arbitrary discrete 
state space. For fixed finite range of the Markov chain, we derive an explicit formula for the joint 
density of all local times on the range, at any fixed time. We use standard tools from the theory of 
stochastic processes and finite-dimensional complex calculus. 

We apply this formula in the following directions: (1) we derive large deviation upper estimates for 
the normalized local times beyond the exponential scale, (2) we derive the upper bound in Varadhan's 
lemma for any measurable functional of the local times, and (3) we derive large deviation upper bounds 
for continuous-time simple random walk on large subboxes of Z'* tending to as time diverges. We 
finally discuss the relation of our density formula to the Ray-Knight theorem for continuous-time 
simple random walk on Z, which is analogous to the well-known Ray-Knight description of Brownian 
local times. In this extended version, we prove that the Ray-Knight theorem follows from our density 
formula. 

1. Introduction 

Let A be a finite or countably infinite set and let A = {Ax^y)x,y£A be the generator, sometimes 
called the Q-matrix, of a continuous-time Markov chain (^t)te[o,oo) on A. Under the measure Pa, the 
chain starts at Xq = a G A, and by Eq we denote the corresponding expectation. The main object of 
our study are the local times, defined by 

er{x)= r l{x.=x}ds, x€A,T>0, (1.1) 
Jo 

which register the amount of time the chain spends in x up to time T. We have {It, V) = /q' V{Xs) ds 
for any bounded function T^: A — > M, where (•,•) denotes the standard inner product on M"^. We 
conceive the normalized local times tuple, j^ir = {^£t{x)) random element of the set M i (A) 

of probability measures on A. 

The local times tuple It = {iTix))xeA, and in particular its large-T behavior, are of fundamental 
interest in many branches and applications of probability theory. We are particularly interested in the 
large deviation of ^^t- A by now classical result |Gar77[ IDV75-83] states, for a finite state space A, 
a large deviation principle for ^ir, for any starting point a G A, on the scale T. More precisely, for 
any closed set T C M.i(A), 

limsup;^logPa(i.£^ G r) < - inf lAifi), (1.2) 



^Department of Mathematics, University of British Columbia, Vancouver, BC V6T 1Z2, Canada, db5d@math.ubc.ca 
■^Department of Mathematics and Computer Science, Technical University Eindhoven, Post Box 513, 5600 MB Eind- 
hoven, The Netherlands, rhofstad@win.tue.nl 

^Mathematisches Institut, Universitat Leipzig, Augustusplatz 10/11, D-04157 Leipzig, Germany. 
koenig@math . uni-leipzig . de 

1 



2 



DAVID BRYDGES, REMCO VAN DER HOFSTAD AND WOLFGANG KONIG 



and, for any open set G C A^i(A), 

liminf llogP,(i,^^ G G) > - inf Ia{^). (1.3) 
T— >oo 1 fi^G 

The rate function 1^ may be written 

lAif^) = - inf {(^5, ^) (0,oo)}. (1.4) 

In case that A is a symmetric matrix, IaIp) = Il(~^)^\//^ll2 equal to the Dirichlet form of ^ appHed 
to 1^/1. The topology used on A^i(A) is the weak topology induced by convergence of integrals against 
all bounded functions A — > R, i.e., the standard topology of pointwise convergence since A is assumed 
finite. For infinite A, versions of this large deviations principle may be formulated for the restriction of 
the chain to some finite subset of A. A standard way of proving the above principle of large deviations 
is via the Gartner-Ellis theorem; see |DZ98j for more background on large deviation theory. One of 
the major corollaries is Varadhan's lemma, which states that 

hm llogE4e^^(^^-)] = - mf [/^(m) - F(/.)] , (1.5) 

for any function F: Mi[K) M that is bounded and continuous in the above topology. We would 
like to stress that in many situations it is the upper bound in H1.5() that is difficult to prove since F 
often fails to be upper semicontinuous. (However, often F turns out to be lower semicontinuous or 
well approximated by lower semicontinous functions, so that the proof of the lower bound in is 
often simpler.) 

In the present paper, we considerably strengthen the above large deviation principle and the asser- 
tion in (|1.5() by presenting an explicit density of the random variable It, i.e., a joint density of the 
tuple {iT{x))xeA, for any fixed T > 0. We do this for either a finite state space A or for the restriction 
to a finite subset. This formula opens up several new possibilities, such as 

(1) more precise asymptotics for the probabilities in (|1.2|) and (|l.i-{j) and for the expectation on the 

left of jni), 

(2) the validity of H1.5() for many discontinuous functions F, 

(3) versions of the large deviation principle for rescaled versions of the local times on state spaces 
A = Aj- coupled with T and growing to some infinite set, 

Clearly, a closed analytical formula for the density of the local times is quite interesting in its own 
right. Unfortunately, our expression for the local times density is rather involved and is quite hard to 
evaluate asymptotically. Actually, not even the nonnegativity of the density can be easily seen from 
our formula. Luckily, upper bounds on the density are more easily obtained. We will be able to use 
these upper bounds to derive proofs of (|1.2|) and of the upper bound in (|1.5j) for every measurable set 
r, respectively, for every measurable function F, which is a great improvement. 

This paper is organized as follows. In Section[21 we identify the density of the local times in Theorem 
12. H and prove Theorem 12. II In Section |21 we use Theorem 12. II to prove large deviation upper bounds 
in Theorem l3.6l Finally, we close in Section 0] by discussing our results, by relating them to the history 
of the problem and by discussing the relation to the Ray-Knight theorem. 

2. Density of the local times 

In this section, we present our fundamental result. Theorem 12.11 which is the basis for everything 
that follows. By 

Rt = supp(^t) ={Xs: s£ [0, T]} C A (2.1) 
we denote the range of the Markov chain. Note that given {Rj. C for some finite set R Q A, the 
random tuple {£Tix))x£R does not have a density with respect to the Lebesgue measure, since the 
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event {irix) = 0} occurs with positive probability for any x £ R, except for the initial site of the 
chain. However, given {Rt = R} for some i? C A, the tuple {iT{x))x£R takes values in the simplex 

+ = {/: i? ^ (0,oo) I ^/(x) =r}, (2.2) 

x&R 

which is a convex open subset of the hyperplane in that is perpendicular to 1. It will turn out 
that on {Rj- = R}, the tuple {iT{x))xeR has a density with respect to the Lebesgue measure ar on 
M^{R) defined by the disintegration of Lebesgue measure into surface measures, 

d^lF{l)= dT / uridl) F{1), (2.3) 
Jo Jm+ 

where F: (0, oo)^ ^ M is bounded and continuous with compact support. 

We need some notation. Let i? C A and let a,b £ R. For a matrix M = {Mx^y)x,yeA we denote by 
det^^^M) the {b,a) cofactor of the R x i?-submatrix of M, namely the determinant of the matrix 
{Ixy^bMx^ylyjka + ^x=b,y=a)x,yeR- We Write det^fe instead of det^'^' when no confusion can arise. By di 
we denote the A x A-diagonal matrix with (x, x)-entry di^, which is the partial derivative with respect 
to Ix- Hence, det^f (M + di) is a linear differential operator of order \R\ — 2 + 5^,6- 

Then our main result reads as follows: 

Theorem 2.1 (Density of the local times). Let A be a finite or countably infinite set with at least two 
elements and let A = {Ax^y)x,yeA be the conservative generator of a continuous-time Markov chain 
on A. Fix a finite subset R of A and sites a,b £ R. Then, for every T > and for every bounded 
measurable function F: (i?) M, 



E4F(£,)V^=,|11|B^=^|] = / F{l)p[^,\l)aAdl), (2.4) 

where, for I G MtiR), 

= i-A + di) [ eS-.e«^--v^^'='''^"'''' TT ^. (2.5) 

J\0,2tt]R "-'7, 2vr 



'[0,27r 

Alternative expressions for the density are found in Proposition 12.51 below. Note that the 
density p^^' does not depend on the values of the generator outside R, nor on T. The formula for 
the density is explicit, but quite involved, in particular as it involves determinants of large matrices, 
additional multiple integrals, and various partial derivatives. For example, it is not clear from (|2.5|) 
that p^^' is non-negative. Nevertheless, the formula allows us to prove rather precise and transparent 
large deviation upper bounds for the local times as we shall see later. As we will discuss in more detail 
in Section^ Theorem 12 . 1 1 finds its roots in the work of Luttinger |Lut83j who expressed expectations 
of functions of the local times in terms of integrals in which there are "functions" of anticommuting 
differential forms (Grassman variables). It is not clear from his work that the Grassman variables 
can be removed without creating intractable expressions. Theorem 12. II accomplishes this removal. We 
also provide a proof that makes no overt use of Grassman variables; the determinant is their legacy. 

To prepare for the proof, we need the following two lemmas and some notation. We write (p = u + iv 
and cf> = u — iv, where u,v £ M^, and we use d^ud^v to denote the Lebesgue measure on x M^. 
Let V') = SxgA '/'xV'x be the real inner product on C^. 

Lemma 2.2. Let A be a finite set, and let M £ C^><^. // M0) > for any (p £ \ {0}, then 

[ d^ud^e-^^'^'^^ = -^^. (2.6) 
y^AxRA det(M) ^ 
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Remark 2.3. By introducing polar coordinates (/, 9) G [0, cxd)^ x [0, 27r]^ via 

</'x = v^ei^^ xgA, (2.7) 

we can transform 

d^ud% = ttI^I n (d^. ^) = 2-l^ld^/d^e (2.8) 
xsA 

and can rewrite (12.61) in the form 



i[o,oo)Ax[o,2.]A (27r)|A| det(M)- 



Proof of Lemma 12.21 We define the complex inner product {(j),tp) = {(p,ip)- Any unitary matrix 
U G C^^^ defines a complex linear transformation on by (f>' = Ucj). By writing (j) = u + \v and 
(f)' = u' + \v' we obtain a real linear transformation U : {u,v) i— > {u',v') on © M^. The map U is 
orthogonal, because 

{u', u') + {v', v') = (ct)', </.') = ([/(/>, U4>) = ((/>, </>) = {u, u) + {v, v) . 

Let M* be the adjoint to M so that {(j),Mip) = [M*(j)^ip). First we consider the case where 
M = M*. The hypothesis M0) > can be rewritten as {(j), Mcj)) > 0, so that M has throughout 
positive eigenvalues X^, x £ A. Since M is self-adjoint there exists a unitary transformation U such 
that U*MU = D, where D is diagonal with diagonal entries Dx^x = > 0. Thus, by the change of 
variables {u',v') = U{u,v), 



d\d\e-^'^'^'t''> = j d^nd^t;e-(<^'^^). 
The integral on the right hand side factors into a product of integrals 

n / dt. / dve-'^^'-'-^'' = Y[^ 



|A| 



.eA- - .,A- det(M)- 

The lemma is proved for the case M = M* . 
Now we turn to the case where M* ^ M. Let 

S = ^{M + M*) and A = ^(M-M*). 

Thus, S and A are self-adjoint and M = S + iA. Also, {(j), Sep) = 3^(0, Mcj)) which is positive by the 
hypothesis. Therefore the eigenvalues of 5 are strictly positive. 

For G C we define M{fi) = S+fiA. For fj, real, the matrix M{ij,) is self-adjoint. Observe that M{fi) 
has throughout strictly positive eigenvalues when // = 0. Hence, the real part of the characteristic 
polynomial of M{^) is non-zero on (— oo,0], and therefore bounded away from zero on (— oo,0], for 
/i = 0. By continuity of the real part of this polynomial in //, the latter property persists to all /.i in a 
suitable open interval / C M containing the origin. Therefore, M(/i) has throughout strictly positive 
eigenvalues for all /j, € I. Thus we have {(p, M[^)(j)) > for all nonzero (j) and all fi & I. 

Now we apply the preceding with M = M{fi), and obtain, for n £ I, 

det(M(/x)) J d\d\e-^'^'^^^^^'t''^ =7rl^l. (2.10) 

Both sides of this equation are analytic in fi for G / because det(M(/x)) is a polynomial in fx, and 
the integral of the analytic function exp(—{(j), M(/x)(/))) is analytic by Morera's theorem and the Fubini 
theorem, as well as the remark that 

L-(</.,M(/.)</.)| ^ I ^ g-(<)!.,50)-K/.(</.,yl</,) ^ g-(0,M{5RM)0), 
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By analytic continuation (|2.1U|1 holds for G / and in particular for n = i. At /i = i, M{n) = M. □ 



Lemma 2.4. Let A be a finite set, let M G C^^^, and v = {vx)x&K £ C^. Then, for any continuously 
differentiable function g : M, 

detab{M + di){e^^^-^g){l)=e^''^'^detab{M + V + di)g{l), leR^, (2.11) 

where V = {SxyVx)x,yGA denotes the diagonal matrix with diagonal entries Vx- 

Proof. By a cofactor expansion, one sees that, for any diagonal matrix W , detafe(M + W) = 
SxcA\{a b} Wx£X ^x,x for Suitable coefficients cx depending only on the entries of M. Analogously, 
deta6(Af + di) = X]xcA\{a b} ^^^i^ ^ where we used the notation = Hzgx ^ix • Therefore, 

e-^'^'^) det,fe(M + di){e^-'-^g){l) = cxe-^"''^ {e<^'-'> g){l) 

XCA\{a,b} 

= E ^xl[{vx + di^)g{l) = det„b(M + V + di)g{l). 

XCA\{a,fe} xeA 

□ 

Proof of Theorem 12. XL We have divided the proof into six steps. In the first five steps we assume 
that A is a finite set, and we put i? = A. Recall the notation in Remark 12.31 which will be used 
throughout this proof. We abbreviate Di = deta6(— ^ — di). 
Step 1: For any v £ with £ (-oo, 0)^, for F{1) = 

rEa[F{ir)l{Xr=b}]<iT= [ {DiFme^^'^^^ J| (d/, ^) . (2.12) 

Jo y[0,oo)Ax[0,2^]A ^g^V 27rJ 

Proof. Recall that {v,£t) = v{Xs) ds to obtain 



poo poo FT 1 rOO 

/ Ea[F{er)t{x,=b}]dT= e/o -(^^)d'^]l^^^^,j dr= / (e^(^+^))^ , dT 

Jo Jo ^ J JO ' 



(2.13) 



where V is the diagonal matrix with {x, x)-entry Vx, and Mx^y denotes the (x, ?/)-entry of a matrix M. 
In order to see the last identity in (|2.13j) . we note that 



and that 



/ (e^(^+^)) .dr= ( / e^(^+^)dr) , (2.14) 

roo roc j 

(A + V) e^(^+^) dT = / -^e^(^+^) dT = -/. (2.15) 
Jo Jo 



By Cramer's rule followed by (|2.9() . 



xeA 



= /■det„i(--4-V)eMe».''?> Ui'^'-'T^ 

xeA ^ 

We use Lemma 12.41 with g = 1 and M = A to obtain that 

detab{-A - y)e<^''> = ^^^^^^ + y) = (_i)|Ahi detab{A + 9/)e<^'''> 

= detab{-A-di)e'^''^'^ = {DiF)il), 



(2.16) 



(2.17) 
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where we recall that Di = detafe(— ^4 — di). Substituting this in (|2.16|1 and combining this with ()2.13p . 
we conclude that (|2.12j) holds. □ 

Step 2: The formula (|2.12() is also valid for functions F of the form 

^(0 = n e C2((0,oo)),supp(/,) C (0,cx)) compact, K^;, < 0. (2.18) 

Proof. Note that H2.12() is linear in F and so if we know it for exponentials, then we obtain it 
for linear combinations of exponentials. In more detail, consider the Fourier representation fx{lx) = 
/x('fWx)e™^'^ dt«^. Apply (|2.12j) for v replaced hy v + \w with w G to obtain 

l^^e' ■ ' ' je I I I — 

'[0,oo)'^x[0,27r]'^ 



Jo yf0.oo-)Ax[0.27rlA / V 



27r 

xgA 



Now multiply both sides with JIxgA fx{wx) and integrate over with respect to d^w. Then we apply 
Pubini's theorem to move the d^w integration inside. From the representation 



we see that fx is continuous by the dominated convergence theorem. Furthermore, fx satisfies the 
bound 

Hence, all functions Wx fx{wx) are absolutely integrable, and the exponentials with < make 
the integration over Ix convergent for any x £ R. □ 

In the following we abbreviate = detafe(— ^ + di). 
Step 3: For F as in (ITTKl) . 

[Fii,)l{xr=b}] dT = I F(0 A*e<^'^^> J] ^) • (2.19) 



Proof. Comparing (|2.12() with this formula we see that it is enough to prove that the integration by 
parts formula 

J {DiF){l) e<*'^^> d^l = J F{1) (Df e<<^'^^>) d^^ (2.20) 

holds for any 9 G [0, 2tt]^. Since Di = detab{—A — di) is a linear differential operator which is first order 
in each partial derivative, it suffices to consider one integral at a time and perform the integration by 
parts as follows: for any x £ A and any fixed {ly)yeA\{x}i 

poo _ pQC _ 

/ {-di^F{l))e^'t''^'f'^dlx= / F{l)diJ't''^'^Ulx, xeA. (2.21) 
Jo Jo 

There are no boundary contributions because the map Ix •— > F{1) has a compact support in (0,oo). 
This proves (ITTTI|) . □ 

Step 4: For any v G C^, 

/"E4e<^'^-)V,=,|l|H,=M]dr= / e^'^'^^Dre^^'^^) J] {^^^T^)' (2-22) 

Proof. Let {fn)neN be a uniformly bounded sequence of smooth functions with compact support in 
(0,oo) such that fn{t) ^ Il(o,°o)(*) for any t. Choose F{1) = Fn{l) = Uxga('''"'^'' fniQ) in and 
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take the hmit as n ^ oo, interchanging the hmit with the integrals using the dominated convergence 
theorem. Observe that hm„^oo -Fn(^T) = ^^'"'^^'^ Y[xeA^{o,oo){^Tix)) = e^'^'^^^lj/jy^A} almost surely. 
Furthermore, lim„^oo-fn(0 = 6^*"''^ almost everywhere with respect to the measure na;eA(*^^^ 
Thus we obtain (|2T22|) in the limit of (f2l9|) . □ 

Step 5: For ah v £C^, 

E,[e'^^^'^H{Xr=b}i{Rr=A}] = f e'^''^^^ p'^,\l) dH, T > 0,a,5 G A, (2.23) 
where pl^i^{l) is given by 1)2. 5(1 . 

Proof. Recall that YlxeA^rix) = T almost surely and that YlxeA^^ = T for I £ M.^{A). Hence, 
without loss of generality, we can assume that ?R.v E (— oo,0)^, since adding a constant C G M to all 
the Vx results in adding a factor of e*^^ on both sides. In 1)2. 22() we replace Vx by t;a: — A with A > 0. 
Then becomes 



re-^^E4e<^'^-)V,=,}V.=A}]dr= / e<^''Oe-^S. /.^*e<<^'^^) H {dlxf^ 
"^0 xeA ^ 



e('''Oe-^E.'.p(^A)^^^ ^A^ ^2.24) 



(0,oo)^ 



oo 

„-AT 



e^''^^p':^{l)aAdl) 

A4 + {A) 





where 

In the second equation, we have interchanged the integrations over I and 9 and have rewritten the 9 
integral using 1)2. 5p . In the third equation in (|2.24|) , we have introduced the variable T = Ix and 
used (jO) . 



Hence we have proved that the Laplace transforms with respect to T of the two sides of (|2.23j) 
coincide. As a consequence, (|2.23|) holds for almost every T > 0. Furthermore, 1)2. 23() even holds 
for all T > 0, since both sides are continuous. Indeed, for small h we have {v,iT+h) = {vj^t), 
Xt+h = Xt and Rt+h = Rt with high probability, which easily implies the continuity of the left 
hand side of (|2.23p . We see that the right hand side is continuous for T > by using the change of 
variable t = T~^l and ()2.5p to rewrite the right hand side as an integral of a continuous function of 
T,t on the standard simplex M.'!^^^{K). □ 

Now we complete the proof of the theorem: 

Step 6: The formula (|2.4() holds for any finite or countably infinite state space A and any finite 
subset i? of A. 

Proof. It is enough to prove ()2.4() for the case F{1) = e^"'^^ with ) G (— oo, 0)^ because the 
distribution of {I!.t{x))x&r on the event {Rt = R} is determined by its characteristic function. 
Consider the Markov chain on R with conservative generator A'^^^ = {A\l^^)x^y^R given by 

t ~ LjyeR\{x} ^x,y II ^ — 
and let y'^' be the diagonal Rx R matrix with Vi.x' = J2yeA\R^x,y Then 

Ai'^l = Ax,y + V^^^ yx,yeR. (2.27) 
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When started in R, the Markov chain with generator A*^' coincides with the original one as long as 
no step to a site outside R is attempted. Step decisions outside R are suppressed. The distribution 
of this chain is absolutely continuous with respect to the original one. More precisely, 



-^(^t)]1{Xt=6} ^{Rt=R} 



F(^,)e-S^.«^-(-)<"'ll|x,=6}Il{/?,=ij} 



T > 0,a,b £ R, 

(2.28) 

where Ea^' is the expectation with respect to the Markov chain on R with generator A^^K Applying 
(|2.23|) for this chain with e^^''^ replaced by 



(2.29) 



and with A replaced by R, we obtain, writing 0, for the restriction of di to R x R 



where 



F,{l)p':^{l)a^{dl)= / F(Opir'(O^T(dO 
M'i.(R) JM^{R) 



= ^-T^^^Ri^vt^ det„fe(-A<«' + dl""') [ e^- 

i[0,27r]« 

By Lemma in fohowed by TTITl . 



y^H <Px-n-X,y (Py 



n 

x£R 



d^ 
27r ■ 



(2.30) 



(2.31) 



p</,«>(0 = det,,(-yi(«'-y(«) +(?;«') 



^l2x,y£R 4'xAxy4'y 



[0,27r]« 



n 

x&R 



d^ 
2tt 



det„fe(-^(«'-y(«) / e^.,y<^R4-A-'y^y T\ 

i[0,27r]« 



x&R 



d^ 
2-K 



(2.32) 



det'^'(-A + 90 / ^T.x,y^R'I^^Ax,y^y TT ^ 



From the definition 1)2. 5p . and using 1)2. 7p . we recognise the last line as p^}, (l)- Therefore, by combining 
(fT^ and (fOn]) we have proved in the theorem. □ 

Now we collect some alternative expressions for the density p^^': 

Proposition 2.5. Let the assumptions of Theorem \2.1\ he satisfied. Let B = {[1 — 5x^y\Ax^y)x,y&A be 
the off-diagonal part of A. Then, for any finite subset R of A and for any sites a,b £ R, and for any 
I G Mt{R), the following holds: 

(i) 



Pab 



)(/) = e>^xeRi^Ax^^ det7 i-B + di) [ ^T.x.,yeRB.,yVrx^ye^^'>'^-^y) T-r 

(ii) For any r € (0, oo)^, 
p<-^\l) = ^T.x^rI^Ax,x det(«) {-B + di) [ e^-«e«^-^--^-"' ^V^-''"-"'^ TT 

(iii) 



x£R 



2-K 



Pab 



d^ 
27r 



(2.33) 



(2.34) 



(2.35) 
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where Vg^i = {Sx,yVg^i{x))x£R is the diagonal matrix with entries 

I 



ve,i{x) = j;i?.,.-^/^e'(^^-^^), x&R. (2.36) 



The formula in ()2.34p will be helpful later when we derive upper bounds on p^^{l) in the case that 
A is not symmetric. The remainder of the paper does not rely on the formula in (|2.35|) . However, 
we find 1)2.35(1 of independent interest, since the integral in ()2.35|) does not involve any derivative. 

Proof. Formula ((2.33(1 follows from ((2.5(1 by using Lemma 12.41 

We now prove ((2.34(1 . Fix r G (0, oo)^ and observe that, for any / G (0, oo)^. 

Indeed, substituting e'^"" = Zx for x G i?, we can rewrite the integrals as integrals over circles in the 
complex plane. The integrand is analytic in G C \ {0}. Hence, the integral is independent of the 
curve (as long as it is closed and winds around zero precisely once), and it is equal to the integral 
along the centred circle with radius rx instead of radius one. Re-substituting r^^e'^"" = Zx, we arrive at 
((2.37(1 . Comparing to ((2.33(1 . we see that we have derived ((2.34() . 

Finally, we prove ((2.35(1 . We use ((2.34() with r = ^/l and interchange det^^' ( — S + 9;) with 27r]fl 
(this is justified by the analyticity of the integrand in all the Ix with x £ R). This gives that 

p^f{l) = eS.efl'.A... f det^ (-B + 5i)eS-.^e«'^^^-«'^'^'^"'''' TT 

Use Lemma l2 . 41 with g = 1 to see that 

det^^' {-B + a,)eS=^^«e«^^e^..e'(«-«.) ^ gE.,,e«^.B...e'(«-''^) ^^^iR) ( _ ^ + y^)^ 

where Ve = {Sx,yVg{x))x£R is the diagonal matrix with entries vg{x) = X^^g/j -B^-^^e'*^^"'"^'-'. 

Now we use the same transformation as in ((2.37^ : We interpret the integrals over 9x as inte- 
grals over circles of radius \/T^ and replace them by integrals over circles with radius one. By this 



transformation, Vq is transformed into Vg^i, and the term q^^.v^r ^ ^■J' is transformed into 

eE^,!/eflV^^-.!'\/'^«=''''"^*'''. Recalling that B is the off-diagonal part of A, ((735|l follows. □ 



3. Large deviation upper bounds for the local times 

In this section we use Theorem 12.11 to derive sharp upper bounds for the probability in ((1.2(1 and for 
the expectation in ((1.5(1 for fixed T and fixed finite ranges of the local times. The main term in this 
estimate is given in terms of the rate function I a- The main value of our formula, however, comes 
from the facts that (1) the error term is controlled on a subexponential scale, (2) the set F in ((1.2p is 
just assumed measurable, and (3) the functional F in ((1.5(1 is just assumed measurable. Let us stress 
that this formula is extremely useful, since the functional F is not upper semicontinuous nor bounded 
in many important applications. 

In Section f3.1l we give a pointwise upper bound for the density, in Section f3. 21 we apply it to derive 
upper bounds for the probability in ((1.2() and for the expectation in ((1.5(1 . and in Section 13.31 we 
consider the same problem for state spaces A = ^ WJ^ depending on T and increasing to Z'^. 

3.1. Pointwise upper bound for the density. Here is a pointwise upper bound for the density. 
Recall the rate function I a introduced in ((1.4(1 . 
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Proposition 3.1 (Upper bound for p^^^). Under the assumptions of Theorem \2.1V for any finite subset 
R of A, and for any a,b R, any T > and any I G Mt{R), 

xeR\{a,b} 

where g G (0,00)"^ is the minimizer in ()1.4p for = ip and 

% = max|max ^ \Bx,y\, max ^ l^^;,?/!, l|, (3.2) 
""^^ j/eR\{x} xeR\{y} 

where B = {[1 — Sx,y]Ax,y)x,yeA is the off-diagonal part of A. 

Remark 3.2. If A (and hence B) is symmetric, tlien 51 = \// is the minimizer in (|1.4|) . and we have 
Ia{^j) = Il(~^)^v^ll2- t^i^ upper bound simphfies to 

pl«)(0<e"^^-(^0( jT)r,lfl-iel^l[^+(^^«^)-^]. (3.3) 

x&R\{a,b} ^ 



The proof of Proposition 13.11 makes use of three lemmas that we will state and prove first. 
Lemma 3.3. Let B £ [0,oo)^''^ be any matrix with nonnegative elements, and let Q C R. Then 

V[o,2.]H 4^ 27r 

where df^ = UxeQ ■ 

Proof. Write e^^-fs-f'" = Hxye-R^ expand the exponentials as power series. For n = 

{nx,y)x,y£R G N^^^^, wc Write n! = Ylx,yeR'^^,y- ^hen we obtain 

' JioM^ xeR 

neN«x« -,y&R ■^["•'^l'' XGR^""' 

After rewriting the exponent in the integral on the right hand side using ^ nx,y{9x — Oy) = Ylx '^x^x-, 
where Ux = YliyiP'x,y — ny^x), it is clear that the integral equals one or zero. Hence, the lower bound 
in 1)3.4(1 is clear, and the upper bound comes from replacing the integral by one and a resummation 
over n. □ 

Lemma 3.4. Fix any matrix B £ R^^^, let a,b £ R, and let f : (0, 00)^ ^ R be any function with 
nonnegative derivatives, i.e., f{l) > for all Q C R. Then 

\det[';i{-B + di)f\<r^^ 11 i^^ + 9i.)f, (3-6) 

x£R\{a,b} 

where rjji is defined in ()3.2() . 

Proof. Recalling that the determinant is the (signed) volume subtended by the rows, we can bound 
a determinant by the product of the lengths of the rows. This is called the Hadamard bound and it 
applies to any real square matrix. Therefore, for X C R and a,b £ X, 

\A<b\-B)\< n ii^-'ii^ n vr=v^r^-\ 

x£X\{b} xex\{b} 



d9x 

xeR 
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where Bx is the row x B after ehminating the a-th column, and || • || is the Euchdean length, 
which is bounded by rjn because ^ |aip < Also, 

detf^{-B + di)f{l)= n {-Bx,^^+^-.^A.)f{l), (3.7) 

cr; R\{b}^R\{a} x&R\{a} 

where the sum over a is over all bijections R \ {6} — > i? \ {a}, and where sign(CT) is the sign of the 
permutation a: R ^ R obtained by letting = Ox for x ^ h and = a. Expanding the product, 
we obtain 

QCR\{a,b} a: Q'=\{b}^Q'^\{a} x'eQ=\{fe} xeQ 

= E detif(-5)(n9z.)/(0, 

QCR\{a,b} xeQ 

where we write = R\Q. Take absolute values and bound the cofactor using the Hadamard bound, 
|detir(-5 + 50/(01 < E ^F^^'^'dl^'O^W 

QCR\{a,b} xeQ 

= Vn Y { n V.){U9i.)f(l) (3.9) 

QCR\{a,b} xe{R\{a,b})\Q xeQ 

= Vn n iVn + di^)f{l). 
x&R\{a,b} 

□ 

Lemma 3.5. Fix any finite subset R of A, let B G [0,oo)'^^'^ be any matrix with nonnegative 
elements, and fix a,b R. Then, for any T > and any I G Mt j 

^ ^ IIr 2- 

r— ^ (3.10) 



,y 



, Ix 

x(iR\{a,b} 

where rjn is defined in (|3.2() . 

Proof. By Lemma 13.41 followed by Lemma l3.3| we obtain 

l.h.s. of (jmH) < »o (,^^ + 5^Je^->^'e«^=='^^^^. (3.11) 

x&R\{a,b} 

Substitute tx = ^ e [0,1] and abbreviate f{t) = e^^-.a6«^"'f By the chain rule, di^ = 



wizdt.- Then 



l.h.s. of eini < r^L^^i-' n (i + ^f^*0^(*) 

xeR\{a,b} " ^^^^^ 

f-p-H n i^) n (i+^^O/o- 

2:eR\{a,6} xG-R\{a,6} 
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where we have used that < 1. Since all t derivatives (not just the first order derivatives) of / are 
nonnegative since Bx^y > 0, we can add in some extra derivatives and continue the bound with 

1 dr 



i.h.s. of EiB <„!?-'( n f) n {^hwTr)'<^*^ 

xeR\{a,b} xeR\{a,b} n=0 ' ^ ' 



\R\-1 
Vr 



(3.13) 



n l)/(t + (2^,r)-i]i 

' xeR\{a,b} 

where the last equation follows from Taylor's theorem, and l^j: R ^ {1} is the constant function. 
Recalling that tx < 1, we may estimate 

ilog/(t + (2r?«r)-i)l«) = ^ Bx,ytxty + ^ Yl ^-At- + ^y) + 7^^ E ^-'V 

x,yGR x,y£R ^ ' x,y(^R. 

We conclude that 

l.h.s. of (jUni) <??!f '~'( n -) /(i)e[^«'+('^«^)"']^-.^efl5-^ (3.14) 

x&R\{a,b} ^ 

Re-substituting tx = ^JU/T and f{t) = Q^^^.yeR^^^v^^'ty ^ the lemma is proved. □ 

Proof of Proposition 13. IL Fix any r G (0, oo) and recall the representation of the density in 
(|2.34p . Now apply Lemma for B = {rxBx^yr~^)x,y<^R, to obtain 

x(^R\{a,b} 

Now we choose r = Vl/g, where g G (0,co)'^ is the minimiser in 1)1.4(1 for fi = This implies the 
bound in (|XT|l . □ 



3.2. Upper bounds in the LDP and in Varadhan's lemma. In this section we specialize to 
Markov chains having a symmetric generator A and give a simple upper bound for the left hand side 
of (|1.2p and for the expectation in (|1.5p . Recall from the text below ()1.4() that, in the present case of 
a symmetric generator, /yi(/^) = ||(~^)^y^||2 for any probability measure /i on A. 

Theorem 3.6 (Large deviation upper bounds for the local times). Let the assumptions of Theorem \2.1\ 

he satisfied. Assume that A is symmetric. Fix a finite subset S of A. Then, for any T > 1 and any 
a € S, with rjg as in ()3.2|) . the following bounds hold: 
(i) For every measurable T C Mi[S), 

logFa{^£r er,RrCS)< -T inf \\{-A)h^\\l + |5| log {vsVs'eT) + log |5| + ^. (3.15) 



(ii) For every measurable functional F: Mi{S) M, 




Theorem 13.61 is a significant improvement over the standard estimates known in large deviation 
theory. In fact, one standard technique to derive upper bounds for the left hand side of (|3.15|) is 
the use of the exponential Chebyshev inequality and a compactness argument if F is assumed closed. 
One important ingredient there is a good control on the logarithmic asymptotics of the expectation 
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in (|3.16|) for linear functions F. This technique produces an error of order e°^^\ which can in general 
not be controlled on a smaller scale. 

The standard technique to derive improved bounds on the expectation in 1)3. 16(1 for fixed T is 
restricted to linear functions F, say F(-) = {V,-). This technique goes via an eigenvalue expansion 
for the operator ^ + F in the set S with zero boundary condition. The main steps are the use of the 
Rayleigh-Ritz principle for the identification of the principal eigenvalue, and Parseval's identity. This 
gives basically the same result as in 1)3. 16() . but is strictly limited to linear functions F. 

Proof of Theorem 13.61 It is clear that (ii) follows from (i) , hence we only prove (i) . 

According to Theorem 12. 11 we may express the probability on the left hand side of (|3.15j) as 

.ay^iT^T,R,<ZS)=Y, E / pf^{l)<y^{dl), (3.17) 



where T^^r = TFr, and Tn is the set of the restrictions of all the elements of F to R. 

We fix a, 5 € S* and i? C 5 with a,b G R and use the bound in Proposition 13.11 more precisely, the 
one in (|3.3j) . Hence, for / G ^A^{R) Ci Trp^^, we obtain, after a substitution I = Tji in the exponent, 
that 

p^«)(/) <e-^"^W:Bupp(M)Cflll(-^)^v^l!i(^ n y^)??L^'~^el^l[i+(*''«^)"'l (3.18) 

x&R\{a,b} ^ 

Substituting this in 1)3. 17() and integrating over I G Al^ (/?), we obtain 

E / + , n vr^^^"^^^ (3-19) 

b&S R<^S: a,b<^R''^TW xeR\{a} ^ 

In the last integral, we have eliminated la = T — X^yg/j^j^} ly, have extended the {\R\ — 1) single 

integration areas to (0,T) and used that Ix ^ dlx = v2T. Now we use that rja is increasing in R 
and greater than or equal to one to arrive at ()3.15|) . This completes the proof of (i). □ 



3.3. Rescaled local times. As an application of Theorem 13.61 we now consider continuous-time 
simple random walk restricted to a large T-dependent subset A = A^ of Z"' increasing to Z"'. We 
derive the sharp upper bound in the large deviation principle for its rescaled local times. Assume, for 
some scale function T i— > S (0, oo), that Ay is equal to the box [—Rax, -Ra^]'^ H Z'^, where the scale 
function satisfies 

l<^aT<^i- — ^1''^' asT^oo. (3.20) 
Vlog T/ 

We introduce the rescaled version of the local times, 

Note that Lj. is a random step function on W^. In fact, it is a random probability density on M"^. 
Its support is contained in the cube [—R, R]'^ if and only if the support of £t is contained in the box 
[-RaT,RaTfnZ'^. 

It is known that, as T — > oo, the family (Lt)t>o satisfies a large deviation principle under the 
sub-probability measures P(- n {supp(L-r) C [—R,R]'^}) for any R > 0. The speed is Ta^^, and the 
rate function is the energy functional, i.e., the map g"^ ^ f llVfi'lli' restricted to the set of squares of 
L^-normalized functions g such that g lies in H^{M.'^) and has its support in [—R, i?]^. The topology is 
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the one which is induced by all the test integrals of against continuous and bounded functions. This 
large-deviation principle is proved in |(TKSfl5j for the discrete-time random walk, and the proof for 
continuous-time walks is rather similar (see also jHKMOS] . where the proof of this fact is sketched). 
Hence, Varadhan's lemma yields precise logarithmic asymptotics for all exponential functionals of Lj. 
that are bounded and continuous in the above mentioned topology. 

Note that this large deviations principle for Lj. is almost the same as the one which is satisfied 
by the normalized Brownian occupation times measures (see |Gar77[ IDV75-83] ) , the main difference 
being the speed (which is T in |(lar77| lDV75-83j instead of Ta^^ here) and the fact that Lt does not 
take values in the set of continuous functions M'^ — > [0,oo). 

Here we want to point out that Theorem 13. 61 vields a new method to derive upper bounds for many 
exponential functionals of Lt- For a cube Qd M"^, we denote by M\{Q) the set of all probability 
densities Q — > [0, oo). 

Theorem 3.7. Fix R > 0, denote = [—R,R]'^ and fix a measurable function F: Mi[Qn) — > M. 
Introduce 

X = inf {i||V<7||i - F{g^):g G H\W'), \\g\\2 = l,supp(ff) C Q^}. (3.21) 



Then 



provided that 



al , „ r ( T 



lim sup — log E 

T-*oo T 



exp 



{^^(^T)}l{supp(iT)cQ«}] < -X, (3.22) 
hminf ^^inf 1 ^ J^y^ _ y^^^ _ ^^^^^^^^ ^ ^^^^^^ 



Proof. Introduce 

Fr{^Ji) = ^F[ai^Ji{[■a^\)), fi£Mi{Z^), 

then we have -^F{Lj.) = Ft{y(-t)- Hence, Theorem I3.6r ii) yields that 
T 



E 



{ } ^{supp{L:r)CQ«}] = E [ exp {t ( ^^t) } 1{supp(£t)CQ«„^ } 

< Qo(Ta-'^)^-TxT ^ 



where ^ ^ 

xt = inf (o (\//^(2;) - \/My)) -^t(^) 

Here we used that the two error terms on the right hand side of (|3.16|) are e°i'^°'T ) since rjs < 2d for 
any S QIJ^ and because of our growth assumption in ()3.2U() . Now (|3.22|) follows from (|3.23|) . □ 

Theorem 13.71 proved extremely useful in the study of the parabolic Anderson model in jHKM 05] . 
Indeed, it was crucial in that paper to find the precise upper bound of the left hand side of ()3.22|) for 
the functional 

Fig"^) = / g'^{x)\ogg'^{x)Ax, 
JQr. 

which has bad continuity properties in the topology in which the above mentioned large deviations 
principle holds. However, Theorem 13.71 turned out to be applicable since the crucial prerequisite in 
H3.23() had been earlier provided in |GH99j . The main methods there were equicontinuity, uniform 
integrability and Arzela-Ascoli's theorem. 

In the same paper |HKM05] . also the functional 



F^g"^) = - |5(x)p'^ dx, with some 7 G (0, 1) 
Jqr 
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was considered. This problem arose in the study of the parabohc Anderson model for another type of 
potential distribution which was earlier studied in [BKOlj . The prerequisite in (|H.2l'{j) was provided in 
using techniques from Gamma-convergence; see jAC04j for these techniques. 

4. Discussion 

In this section, we give some comments on the history of the problem addressed in the present 
paper. 

4.1. Historical background. The formulas in this paper have been motivated by the work of the 
theoretical physicist J.M. Luttinger |Lut83j who gave a (non-rigorous) asymptotic evaluation of certain 
path integrals. Luttinger claimed that there is an asymptotic series 

E[e-^^(^-/T)] ^ Vre-oT^^^ + I + || + . . . ) 

for Brownian local times. He provided an algorithm to compute all the coefficients. He showed that 
his algorithm gives the Donsker-Varadhan large deviations formula for cq and he explicitly computed 
the central limit correction ci. 

In |BM91j Brydges and Muhoz-Maya used Luttinger's methods to verify that his asymptotic ex- 
pansion is valid to all orders for a Markov process with symmetric generator and finite state space. 
The hypotheses are that F is smooth and the variational principle that gives the large deviations 
coefficient cq is non-degenerate. Luttinger implicitly relies on similar assumptions when he uses the 
Feynman expansion for his functional integral. 

Thus there remains the open problem to prove that Luttinger's series is asymptotic for more general 
state spaces, in particular, for Brownian motion. As far as we know, the best progress to date is in 
|BDT95j where compact state spaces were considered and the asymptotics including the ci correction 
was verified. 

Luttinger's paper used a calculus called Grassman integration. The background to this is that 
the Feynman-Kac formula provides a probabilistic representation for the propagation of elementary 
particles that satisfy "Bose statistics". To obtain a similar representation for elementary particles 
that satisfy "Fermi statistics" one is led in |Ber87j to an analogue of integration defined as a linear 
functional on a non-Abelian Grassman algebra in place of the Abelian algebra of measurable functions: 
this is Grassman integration. An important part of this line of thought concerns a case where there is a 
relation called super symmetry. This background gives no hint that Grassman integrals are relevant for 
ordinary Markov processes, but, nevertheless, Parisi and Sourlas |PS80j and McKane |McK80j noted 
that random walk expectations can be expressed in terms of the Grassman extension of Gaussian 
integration. Luttinger followed up on these papers by being much more explicit and precise about the 
supersymmetric representation in terms of Grassman integration and by deriving his series. 

In |LeJ87j Le Jan pointed out that Grassman integration in this context is actually just ordinary 
integration in the context of differential forms. The differential forms are the non-Abelian algebra 
and the standard definition of integration of differential forms provides the linear functional. Since 
integration over differential forms is defined in terms of ordinary integration one can remove the 
differential forms, as we have done in this paper, but this obscures the underlying mechanism of 
supersymmetry. The formalism with differential forms is explained in |BI03bl page 551] where it 
is used to study the Green's function of a self-repelling walk on a hierarchical lattice. Two other 
applications of the same formalism are the proof of the Matrix- Tree theorem in |Abdfl3j and a result 
on self-avoiding trees given in |BI03aj . 

Luttinger found an instance of a relation between the local time of a Markov process on a state space 
E and the square of a Gaussian field indexed by E. The first appearance of such a relation was given 
by Symanzik in |Sym69 . His statement is that the sum of the local times of an ensemble of Brownian 



loops is the square of a Gaussian field. The references given above to Parisi-Sourlas, McKane and 
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Luttinger removed the need for an ensemble by bringing, in its place, Grassman integration. The paper 
of Symanzik was not immediately rigorous because he claimed his result for Brownian motion but it 
makes almost immediate sense for Markov processes on finite state spaces only. Based on this work a 
rigorous relation between the square of a Gaussian field and local time of a random walk on a lattice 
was given by Brydges, Prohlich and Spencer in |BFS82j . Dynkin Dyn831 Dyn84b| |Dyn84a showed 



that the identities of that paper can be extended to Brownian motion in one and two dimensions. 
In this form, the Dynkin Isomorphism, it became a useful tool for studying local time of diffusions 
and much work has been done by Rosen and Marcus in exploiting and extending these ideas, e.g., 
see |MR96[ lEKMKSOOj . The relation between the local time and the square of a Gaussian field is 
concealed in this paper in (|2.12|) which relates the local time ^ to / = {(pl'^ where is Gaussian. This 
is more obvious when (p is expressed as (p = u + w instead of in terms of polar coordinates 4> = \/Ze'^ . 

4.2. Relation to the Ray-Knight theorem. Our density formula in Theorem 12.11 can also be 
used to prove a version of the Ray-Knight theorem for continous-time simple random walk on Z. 
The well-known Ray-Knight theorem for one-dimensional Brownian motion, see |RY91[ Sections XI. 1- 
2], |KS91[ Sections 6.3-4], was originally proved in |Kni63[ Ray63| . It describes the Brownian local 



times, observed at certain stopping times, as a homogeneous Markov chain in the spatial parameter. 
Numerous deeper investigations of this idea have been made, e.g., for general symmetric Markov 
processes |EKMR,Sf)nj . for diffusions with fixed birth and death points on planar cycle- free graphs 
|EK931 rbK96j . and on the relations to Dynkin's isomorphism |She85j . |Eise94j . 

The (time and space) discrete version of the Ray-Knight theorem, i.e., for simple random walk on 
Z, was also introduced in |Kni63j . however it turned out there that it is not the local times on the 
sites, but on the edges that enjoys a Markov property. This idea has been used or re-invented a couple 
of times, e.g., for applications to random walk in random environment [KKS75 . to reinforced random 
walk |Toth96j . and to random polymer measures |(TH93j . 

In the present situation of continuous time and discrete space, it turns out that the local times 
themselves form a nice Markov chain. However, a proof appears to be missing. In fact, up to our best 
knowledge, |MS87j is the only paper that provides (the outline of) a proof, but only for the special 
case where the walk starts and ends in the same point. 

For fixed 6 E Z, we denote 

= mf{t > 0: £t{b) > h}, h> 0, (4.1) 
the right-continuous inverse of the map 1 1— > it{b). We denote by 

1=0 ^ 

the modified Bessel function. 

Theorem 4.1 (Ray-Knight theorem for continuous-time random walks). Let ij- defined in ()1.1[) be 

the local times of continuous-time simple random walk {Xt)t>o on Z. Let 6 G N and h > 0. 

(i) Under ¥q, the process (^^^^(^ — 2;))^_q is a time-homogeneous discrete-time Markov chain on 
(0, oo), starting at h, with transition density given by 



f{hi,h2)=e-'''~^Uo{2y^2), /ii,/i2 G (0,oo). (4.3) 

(ii) Under ¥q, the processes {^T'^{b + x)) ^^^^ and (^T''(~^))a;GNo time-homogeneous discrete- 
time Markov chains on [0, oo) with transition probabilities given by 

P*{hi,dh2) = e^^'6o{dh2)+e~'''^^'^ll^{2y^hJ^)dh2, /ii, /12 G [0, oo). (4.4) 

(iii) The three Markov chains in (i) and (ii) are independent. 
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We note that Theorem I4.1f ii) and an outhne of its proof can be found in |MS87[ (3.1-2)]. This 
proof uses an embedding of the random walk into a Brownian motion and the Brownian Ray-Knight 
theorem; we expect that Theorem I4.ir i) and (iii) can also be proved along these lines. In Appendix 
\K[ using the density formula of Theorem 12.11 we provide a proof of Theorem 14.11 that is independent 
of the Brownian Ray-Knight theorem. This opens up the possibility of producing a new proof of this 
theorem, via a diffusion approximation of the Markov chains having the transition densities in ()4.3|) 
and 1)4. 4() . Furthermore, we emphasize that our proof can also be adapted to continous-time random 
walks on cycle-free graphs and has some potential to be extended to more general graphs. Theorem l2.1l 
contains far-ranging generalisations of the Ray-Knight idea, which are to be studied in future. 
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A. Appendix: Proof of Theorem 14.11 

In this section, we prove Theorem 14 .11 (Recah the discussion in Section [4. 21 ) To prove Theorem 14. 11 
we will need the following proposition, which is of independent interest. Recall that the matrix B is 
the off-diagonal part of the generator A of the Markov chain. Let 

^t(B.,ye^o+By,.c'^0) de_^ t>0,rE,yeZ. (A.l) 

'[0,27r] 27r 

The following does not assume that we are dealing with simple random walk, but holds for any 
continuous-time nearest-neighbor Markov chain on Z. That is, the generator A is a tridiagonal matrix, 
which means that Ax,y = for any x, y satisfying — y| > 2. 

Proposition A.l. Assume that the conservative generator A = {Ax,y)x,yez of the Markov chain is a 
tridiagonal matrix. Let R C Z be a finite interval and let a,b (z R with a < b. Then 



[ n 



Ixly) 



x<ia 



[ n 9x,y{ 
a<x<b 



['[ldl^9x,yi^ 



Ixly ) 



(A.2) 



y>b 
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where y = x + 1. 

Proposition lA. II savs that, for any nearest-neighbor Markov chain, the distribution of the sequence 
of local times possesses a product structure and may be divided into the piece between starting and 
ending point and the two boundary pieces. All the three pieces have Markovian structure, with explicit 
identification of the transition probability function, which is in general inhomogeneous. 

The proof of Proposition lA.ll makes use of the following two lemmas. The first one is purely 
algebraic and shows that the determinant of a tridiagonal matrix, after erasing one row and one 
column, naturally decomposes in a product of three parts. 

Lemma A. 2. Let R C 7j be a finite interval and let a,b & R with a < b. Let M be an Rx R tridiagonal 
matrix. Then 

detab(M) = det(|'"(M) ( J] M,+i,,) det[f^(M), (A.3) 

a<i<b 

where the superscripts < a and > b denote the sets i?'-"' = {i £ R: i < a} and i?'-*"^ = {i £ R: i > b} 
respectively. If the product is over the empty set or if the cofactors apply to empty matrices, then the 
corresponding factor is set equal to 1. 

Proof. Let M^^"' = {Mij)ij^a and likewise for other inequalities as superscripts. Let M denote 
the matrix obtained by removing row a and column b from M so that Mij = Mj:^j^^ g(^j-j , where f{i) = i 
for i < a and f{i) = i + 1 for i > a. Likewise g{j) = j for j < b and g{j) = j + 1 for j > b. In the 
proof, we distinguish two separate cases, depending on whether a = b or a < b. 

Case a = b. Then it is easy to see that M = M«") M(>"' is block-diagonal. Since det(M«"') = 
det^|'''(M) and det(M(>'"') = det^f^^M), whereas the middle term on the right of (lOl) is an empty 
product, the result (|A.3|1 follows immediately. 

Case a < b. The i?*^"'' x i^'^^'-submatrix of M (the upper left corner) is equal to M*^"', and 
right of this block there are throughout zeros in M, except for the last row (the row indexed by a). 
Analogously, the i?'-*"' x ii'-'''-submatrix of M (the lower right corner) is equal to M'-*"' = M'-^''\ and 
there are throughout zeros above that block in M, except for the first column (the column indexed 
by b). The intermediate block {Mij)a<ij<cb is in upper triangular form since, for i = a, . . . , 6 — 1 and 
j > i, we have Mij = Mff^^-^^gf^j-^ = Mj+ij = 0. Furthermore, the only non-zero entries below the 
diagonal of M are in the diagonal that is next to the main diagonal. 

We are going to calculate the determinant of M by applying linear row and column operations that 
transform M into upper triangular form. For i = min ii, . . . , o — 2, we add a suitable multiple of the 
z-th row to the {i + l)-st row in order that the upper left corner is turned into a upper triangular 
matrix. Note that these operations do not affect any entry outside this corner. Furthermore, for 
j = max i?, max i? — 1, . . . , 6 -|- 1, we add a suitable multiple of the j-th column to the (j — l)-st 
column in order that the lower right corner is turned into an upper triangular matrix. Note that these 
operations do not affect any entry outside this corner. 

The resulting R x i?-matrix is in upper triangular form, and, since row additions do not change 
the determinant, its determinant is equal to det(M) = detafe(M). This determinant is equal to the 
product of the three determinants of the left upper corner (which is det(M*^''') = det*jf'''(M)), the 
right lower corner (which is det(M^>''') = det[|'''(M)) and the product of the diagonal entries of the 
piece inbetween, which is Hta ~ Y\a<i<h^i+^,i- This ends the proof. □ 

Now we state and prove the second lemma that will be used in the proof of Proposition lA.il 
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Lemma A. 3. Let V be a finite interval in Z with |V^| > 2 and let c he the smallest or the largest 
state. Then, for every I G M^, 

detZ'>{-B + di)[ n 9x,y{^/Tjy) 
x,y&V\{c} 



0, 



deiZ' {-B + di)[ n 9x,y{VlJ'y) 



x,yeV 



Y\_ '^lz9x,yi\/lxly), 

x,y&V 



(A.4) 
(A.5) 



where y = x + 1 and where z = x if c is the largest state and z = y if c is the smallest state in V. 



Proof. We first prove (|A.4|) . In Theorem 12. 11 choose F{1) = f{lc) to depend only on 1^ and integrate 
over T, to obtain that 

' dTE,[f{e,{c))t{Xr=c}T^{Rr=V}] = [ dlcfik) [ pZ\l) d''\^'h . 



In the left hand side the indicator functions of the events {Rt = V} and {X^ = = c} (recall that 
\V\ > 2) require the Markov chain to visit c at least two times. Conditioning on the number of visits 
to c to be ric, the amount of time ^t(c) spent at c is the sum of ric > 2 exponential random variables 
with parameter Ac,c- The density at of a sum of two or more exponential random variables is zero. 
Therefore, for lc = 

\Z\l)d''\^''^l = Q. 



It can be seen from ()2.33() that Ic i-^ p'cc.\l) is continuous at Ic = 0. Therefore, /Occ'(0 = at /c = 0. 
Also by for 1^ = 0, 



= det^r'(-i? + az)[ n 9^,yi^ 



Ixly) 



x,y&V 



In det^^' ( — + 5;) no derivative with respect to Ic appears. Also gx,yiO) = 1. Therefore, for Ic = 0, 
we may replace V hy V \ {c} under the product sign. But this is HA.4|1 . 

Now we prove ()A.5|) . The proof is by induction on the number of elements, n, in V. For n = 2 the 
statement is easily checked. This initialises the induction, and we are left to advance it. We give the 
argument only for the case where c is the smallest vertex in V; the other case is essentially the same. 
We split the product into 

9x,yi\/lxly) = gc,c+l{\/lclc+l) gx,y{\/lxly) 
x,y&V x,y<^V\{c} 

apply the differential operator det*.J^'(— i? + di) and use the product rule of differentiation for the 
derivative with respect to di^^-^. Since detj,^ = det'^^''''^' is linear in the first row we therefore have 



l.h.s. of ^EM = {di^+^gcc+iiVldc+i)) ( det 



B + di) Yl gx,y{y^y) 
x,yeV\{c} 

+ 9c,c+l{^Acl^l){detZ^ i-B + di) II 9x,y{\/lxly) ) • 

x,yeV\{c} 

By the induction hypothesis, the first term is equal to 

{dl^+^gCc+liVldc+l)) Yl \9x,y{\/lJ'y) = JJ \9x,y{^Jlxl'y) ■ 
x,y&V\{c} x,y£V 



(A.6) 



On the other hand, by HA.4|) . the second term is equal to zero. This advances the induction, and, 
thus, completes the proof of ()A.5|) . □ 
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where we used our convention y = x + \. By Lemma lA.21 we rewrite this as 
= eS-«^-^'- [det(|") [-B + di)\{ 9.,y{^y)\ 



(A.7) 



(A.8) 



x<a 



y>b 



a<.x<b 



By Lemma Fa .31 this equals the right-hand side of HA.2|) . 



□ 



Proof of Theorem 14.11 We specialize Proposition lA.ll to simple random walk, whose generator 
A = {Ax^y)x,yez is the Laplace operator, i.e., the tridiagonal matrix satisfying Ax^y = 1 for |x — y| = 1 
and A^ 



^x,x — ~2 for X G Z. By HA.1|1 and since Bx^y = By^x = 

9x,y{t) 



[0,271 



2icos6» ^6* , , 

^ = ^o(2t). 



(A.9) 



Fix a finite interval i? C Z containing a,b. Proposition IA.l| gives that, using that Ax^x = —2 and 
using the convention /i+maxij = l-i+minR = 0, 

p[l\l) d^7 = e^'-'"« [ n e"('^+'")a,,/o(2v^) dlx] [ J] e~'^'^~''yhoi2y^) dlx 



LC<a 



a<x<b 



X [ II e-^'-+'y^dijQ{2,JTj'y) d/J e-'— « 

y>b 
yGR 

[llP''ilx,dlx-l)][ n filxJx+l)dlx][llP''ilx,dlx+l) 



(A.IO) 



a<x<b 



x>b 
xGR 



This is the fixed-time equivalent of Theorem 14.11 To go to the stopping time T^, we claim that, for 
any measurable set C C (0, oo)^\^^\ 

P((£2^.(x)),e^\|6| G C,supp(£y,0 = R,Tt G dT)dh 

= r{{er{x))x^H^^{b} G C,supp(£^) = R, = b,ir{b) G dh) dT. 



(All) 



Indeed, ([A.llll implies, for any bounded measurable functional F: {0,oo)^ — > M and any bounded 
measurable function /: (0, oo) — > M, that 



(A.12) 



f{h)Ea[F{U,)t{n.=R}]dh= / Ea[F{UniR,=R}tiXr=b}f{U{b))]dT. 



By Theorem O and ((231), the right hand side is equal to /(o,oo)« ^i^)fih)p'ab (I) d^l. Equation (TOTHl 
gives that, on the event {supp(£T^h) = R}, the distribution of ^-r^h is the one that is claimed in Theorem 
14.11 Hence, Theorem 14. 11 follows from ()A.11|) . 

We now prove (|A.1H) . It is sufficient to prove that, for every h > 0, 



(A.13) 



F[{ej.n{x))xeR\{b} G C,supp(£^.) = RX G {T,T + e] 



'{ieTix))xeR\{b} G C, suppiir) = R,Xr = b,£r{b) G (/i - £, /i)) +o(e), as e j 0. 
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Equation (|A.13|) is a consequence of 
ni^T,^ix))xeB\{b} G C,supp(£^,0 = R,Tt G {T,T + e)) 

= P((^y/.(x))^eR\|b} G C,supp{eTh) = R,Xt = feVt G (T, T + e), ^^(fe) G (/i - e, /i)) +o(e). (A.14) 

Indeed, HA.13|) follows from HA.14|) since, conditionally on the event {Tj^ G (T, T + e)}, with high 
probability, the random walker spends all the time in the interval (T, T + e) in 6 and therefore does 
not change the local times in any other point than b during that time. 

To prove (Ulil) . note that, on {Tj^ G {T,T + e)}, we have ^^(fe) < h < £t+M. Since also 
it+s{b) < + s for any t,s > 0, we also have that irib) G {h — e,h]. This shows that {Tj^ G 
(T,r + e)} C {^y(6) G (/i-e,/i]}. Furthermore, on {T/^ G (r,r + e)}, there is at G (r,T + e) such 
that Xt = b. On this event, the probability of the event {3s G (T, T + e) : Xg 7^ 6} is < 0{e'^), since 
irib) G {h — e, h] on this event and at least one step happens during the time interval (T, T + e). Since 
^rib) has a density, this first event has probability < 0{e) the second has probability < 0{e), and by 
the Markov property at time T, the intersection of these events has probability < 0{e'^). This ends 
the proof of (|Xl4|) . □ 



